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Abstract 



jrt ' The extremes of a univariate Markov chain with regulary varying stationary 

marginal distribution and asymptotically linear behavior are known to exhibit 
a multiplicative random walk structure called the tail chain. In this paper, we 

►^ extend this fact to Markov chains with multivariate regularly varying marginal 

t^^ ' distribution in R''. We analyze both the forward and the backward tail process 

m ■ 

^O ' and show that they mutually determine each other through a kind of adjoint 

^ . ' relation. In a broader setting, it will be seen that even for non-Markovian 

A—^ I underlying processes a Markovian forward tail chain always implies that the 

v^ I backward tail chain is Markovian as well. We analyze the resulting class of 
limiting processes in detail. Applications of the theory yield the asymptotic 

, J , distribution of both the past and the future of univariate and multivariate 

}_( , stochastic difference equations conditioned on an extreme event. 
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1. Introduction 

Consider a discrete-time, M'^-valucd random process {Xt : t = 0,1,2, .. .} defined by 
the recursive equation 



Xt = 1>iXt^i,et), 



t 



1,2,.. 



(1.1) 



where 



(i) £1,62, .. . are independent and identically distributed random elements 

of a measurable space (E,f ) and independent of Xq; (1-2) 

(ii) $ is a measurable function from R'^ x E to M'^. 

If the process {Xt] happens to be stationary, it will be assumed to be defined for 
all integer t. The distribution of Xq is assumed to be multivariate regularly varying. 

The aim of the paper is to analyze the special structure of weak limits of the finite- 
dimensional distributions of the process conditionally on ||Xo|| being large, where || • 
II denotes the Euclidean norm. More precisely, we will investigate the weak limits, 
called the forward tail chain, of vectors of the form {X{), . . . ,Xt) given that ||Xo|| 
exceeds a high threshold. If in addition the process is stationary we will extend this 
to find the so-called back-and-forth tail chain, which corresponds to the weak limits of 
vectors of the form (X_s, . . . ,Xt) given that ||Xo|| is large. A close relation of these 
processes to multivariate regular variation of the whole process has been analyzed in 
Basrak and SegersI (120091 ). In this article, we are interested in the special form of the 
processes, in particular the Markovian structure of both the forward and the backward 
process and how they necessarily determine each other. 

The process {Xt\ is obviously a discrete-time homogeneous Markov chain. On 
the other hand, every homogeneous discrete-time Markov chain { ^t } on a complete 
separable metric space can be represented as in ()l.ip - (|1.2|) (JKifen . 119861 ). Of course, for 



a given Markov chain {Xt\ the above representation is not unique. Still, in examples, 
the way in which Markov chains are defined is often through a recursive equation; all 
examples in iGoldid (19911 PP- 126-127), for instance, arc of this type. The chain is 
stati onary if and o nly if the random v ectors Xi = $(Xo,£i) and Xq are equal in law. 



In 



SmithI (|l992l ) and iPerfektl (|l994l ). excursions of a univariate Markov chain over 



a high threshold following an extreme event are shown to behave asymptotically and 
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under quite general conditions as a (multiplicati ve) random w alk. The theory has 



been extended to multivariate Markov chains in 
Markov chains in 



YunI ( 19981 



Perfekti (119971) and to higher -order 



Resnick and Zeberl (J2013l ) have 



20001) . More recently, 
analyzed the topic with a special view towards the convergence of Markov kernels and 
added a criterion to distinguish between extreme and non-extreme states of a Markov 
chain as the threshold rises. The random- walk representation is useful from a statistical 
perspective becaus e it giv es a handle on how to model the extremes o f certain time series 



(JBortot and Colej |2000l ) 



Coles et al. 



Smith et al. 



(119971) '). A useful, well- 



(I1997D : 

investigated class of processes for which the random walk structure is quite revealing 
are the stationary solutions to certain stochastic difference equations, including squared 
(generalized) aut oregressive conditiona ll y heteroskedastic (ARCH/GARCH) proce sses 



as a special case (JBasrak et al 



(l2002bl); 



A limitation of the theory of lSmithI |l992l ). IPerfektl (|l99J) and 



Gomes et al 



(2004) 



de Haan et al 



19891)) 



Resnick and Zeber 



(l2013f) is that it is specialized to univariate, nonnegative Markov chains. Similarly, 
Perfekti (jl997l ) only considers the upper extremes of a multivariate Markov chain. 
When extending the theory to real-valued and higher dimensional chains, one has to 
keep in mind that extremes may be both positive or negative and that extreme values 
oi Xt may depend not only on HXt^iH but also on Xt/||Xt_i||. The simplest case of 
the extension on which we will focus deals with real- valued univariate Markov chains, 
where an extreme value of Xt may depend on the sign of A"f_i as can be observed for 
instance in time series of logreturns of prices of financial securities in periods of high 
volatility. The observation of this so-called leverage effect has lea d to the form ulation 
of asymmetric extensions of GARCH models (cf., for example, IZivoti (|2009f )). For 
such Markov chains with tail switching potential, the random walk representation 
of excursions over high thresholds breaks down in the sense that the distribution of 
the multiplicativ e increment now depend s in general on the sign of the chain on the 



previous step. In 



Bortot and Colea (|2003t ) , a more general representation is postulated, 



involving in fact four transition mechanisms rather than one, corresponding to the four 
cases of transitions from and to upper or lower extreme states. 

The novelty of this paper is two-fold: first, to explicitly state the random walk 
representation in the general ]R''-valued case; second, in the stationary case, to study 
the joint distribution of the forward and backward tail chain, coined the back- and- 
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forth tail chain. Throughout, some remarkable simphfieations in the (univariate) real- 
valued case will be studied in more detail. In particular, in the univariate case the 
backward tail chain is again a random walk which is in some sense dual the forward 
tail chain. Besides the assumption that the distribution of Xq is regularly varying, the 
only condition is a relatively easy-to-check statement on the asymptotic behaviour of 
$(a;, • ) for large [|x||. 

The outline of the paper is as follows. The forward tail chain of a possibly non- 
stationary M''- valued Markov chain is studied in section ^ For stationary Markov 
chains, the tail chain can be extended to the past of the process, the backward tail 
chain, see section[3] Section|3]describcs a kind of adjoint relation between distributions 
which is motivated by a general property of tail processes of stationary processes. In 
section [51 we show that a certain class of processes, coined back-and- forth tail chains, 
which are derived from this adjoint distribution, form exactly the class of tail processes 
which arise in our Markovian setting. Finally, section |6] provides some examples to the 
theory, including an application to stationary solutions of (multivariate) stochastic 
difference equations. 

To conclude this section, let us fix some notations. We write (a;)+ ~ max(x,0) for 
the positive part of .t G K and (x)_ = min(a;,0) for the negative part. The transpose 
of a matrix A is denoted by A' . The law of a random vector X is denoted by C{X); 
weak convergence of probability measures is denoted by ■^. The probability measure 
degenerate at a point x is denoted by 6x , and \Jmi{E) denotes the uniform distribution 
on a compact set E. The indicator of an event A is denoted by 1a{-)- We write E for 
M U {— oo, oo}, S"^^^ for {a; G M"^ : ||.t|| = 1} and for a vector (of suitable dimension) 
which consists of all zeros. Let Z be the set of integers and No be the set of nonnegative 
integers. 

2. Forward tail chains 

Let Xq, Xi, X2, ... be a homogeneous Markov chain as in (|1.1|) and (|1.2|) . not neces- 
sarily stationary. The focus of this section is on the weak limits of the finite-dimensional 
distributions of the process conditionally on ||Xoj| being large (Theorem 12. ip . Two 
conditions are required: Condition 12.11 on the tails of Xq, and Condition 12.21 on the 



Resnidd ( 2007 ) for details 



Markov tail chains 

asymptotics of a; n- $(x, e) for large ||a;||. Sec for instance 
on multivariate regular variation. 

Condition 2.1. The distribution of Xq is multivariate regularly varying on K. \ {0}, 
that is, there exists a non-degenerate probability measure T on S**^^ (called the spectral 
measure) and an a > such that 

lim P (\\Xo\\ > ux, -^ 6 S \\Xo\\ > x) = u-^T{S) (2.1) 

2:^00 \^ ll^oll / 

for all Borel sets S C S'^^^ which satisfy T{dS) ~ and u > 1. 

The second condition states that the function $ in (jl.ip is asymptotically homoge- 
neous in X for large values of ||x||. 

Condition 2.2. There exists a measurable map (f) : S'^~^ x E h- > R'* such that, for all 

eeE, 

lim x~'^^{xs{x), e) = (t){s, e) (2.2) 

whenever s{x) -^ s in S''^^. 

Moreover, ifP{(j){s,ei) = 0) > for some s G S''^^, then also P(ei G W) = 1, where 
W is a measurable subset of E such that for all e G W, 

sup |$(?/,e)l = 0(a;), x ^ 00. (2.3) 

\\v\\<^ 

We extend the domain of the limit function (p in p.2p to R"* x E by setting 

\vU{v/\\v\le) iiv^O, 

(2.4) 

if 1; = 0. 
Lemma 2.1. // Condition \2.S\ holds, then 

lim x~ ^{xv{x),e) = (^(u, e) (2-5) 

x— >oo 

whenever v{x) — ;■ v G M"* \0 and e G E. //P(0(s,£i) = 0) > for some s G S'*^"'^, then 




(|2.5P also holds for v{x) ^ v = and e G W. 

Proof If v{x) -^ V e W^\0, then both ||w(a;)|| -^ \\v\\ and v{x)/\\v{x)\\ -^ v/\\v\\ 

Thus 

,. ^{xv{x),e) <^{x\\v{x)\\{v{x)/\\v{x)\\),e) 

hm = hm \\v[x)\\ \rT~^\ "^ W^Hiv Ph e) 

which, by ((2^ . gives ([23)1 . The case u(x) -> follows from (|23| . 
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Theorem 2.1. Let {Xt : t e No} be given by prT|) - (|L^ . // Conditions [Q] and 
hold, then for every integer t > 0, as x ^>- oo, 

•||Xo|| Xo Xi Xt 



X 'ii^oii'ii^oir '11^0 



X4>x\-^ C{Y, Mo, Ml, ..., Mt) (2.6) 



with 



and 



A/j=0(Afj_i,ej), j = l,2,..., 



(2.7) 



(i) Y,MQ,ei,e2, ■ ■ ■ are independent with St as in (|1.2p Aj; 

(it) P(r > y) = y-" /or y > 1; (2.8) 

fiMj C{Mo) = T. 

Proof. The argument is by induction on t. The case i = is a straightforward 
consequence of Condition l2.1l So let i be a positive integer and let / : M x (R'^)*+^ -^ M 
be bounded and continuous. We have to show that 



lim E 

a:— )-cxD 



/ 



l-'^oll -'^O ^t 



\Xo\\ >x 



^ '||^o||'--"|l^o| 
By dn]), if Xa + 0, 

Xt HXt^i,et) $(x^fet,£*) 



= E[f{Y,Mo,...,Mt)]. (2.9) 



Hence, 



E 



1^0 II 11^0 



I -'^o 1 1 ^0 Xt 



A\Xo\\ 



E 



^ '||^o||"--'|l^o| 



Xoll > X 



(2.10) 



9x 



where 



Define 



By(E2D, 



gx{y,xo,.-.,xt^i) = E 



/ y,XQ,...,xt-i 



IXnll >X 



^{xyxt-i,St) 
xy 



(2.11) 



g(2/,Xo,---,a;t^i) = ^[f{y,xo,. ■ ■ ,Xt-i,(j){xt-i,et))]. (2.12) 



E[/(y, A/o, . . . , Mt)] = E[g(y, Mo, . . . , Mt-i)]. 



(2.13) 
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In view of the identities (|2.10p and (|2.13p , the hmit relation in 
can show that 

|Xo|| Xq Xt-i 



win foUow if we 



E 



9o: 



\X4 >x 



E[g{Y,Mo,...,Mt-i)] (2.14) 



^ \\Xo\\ '\\Xo\ 
as X — > oo. In turn, (j2.14p wih foUo w from the induction hypothesis and an extension 



of the continuous mapping theorem (jvan der Vaartl . ll998l Theorem 18.11) provided 

hm gx{y{x), xo{x), ..., xt^i{x)) = g{y, xq,..., Xt-i) (2.15) 

whenever y{x) -> y and Xi{x) -^ Xi a.s x ^ co with (y, xq, . . . , Xt-i) ranging over a set 
^ C K X (M.'^y with P((r, Mo, . . . , Mt-i) £ E) ^ 1. From the definitions of g^: and g 
in (|2.1ip and (|2.12p . respectively, equation (|2.15p is implied by 



^{xw{x),v) 
lim = <p[w,v) 



(2.16) 



whenever lim^^-i-oo w{x) = w and where w and v range over sets that receive probability 
one by the distributions of Mt-i and ei, respectively. Since (j2.16p is ensured by 
Condition 12^ and Lemma \2A[ the statement follows. 



3. Backward tail chains 

From now on, the process {Xt} in (II. ip and (|1.2I) is assumed to be strictly stationary. 
A necessary and sufficient condition for stationarity is that 



CmXo,si))^C{Xo). 



(3.1) 



It may be highly non-trivial to find the law for Xq that solves p.ip . But even 
when the stationary distribution does not admit an explicit ex pression , its ta il s may 
in ma ny ca ses be f o und b y the theory developed originally in iKestenI ( 19731 ). 



Letac 



(Il986r) and iGoldid (Il99l[). For recent results o n specific models, see for instance 



Klijppelberg and Perganienchtchikovl (12003 , 



Buraczweski et al. 



2012 ). and 



2004 L 



De Saporta et al. 



Collamore and Vidvashankaij ( 



20131) 



daooj), 



Mirekl(|2011[ ). 



If the process {Xt} is stationary, then by Kolmogorov's extension theorem and 
changing the probability space if necessary, the range of t can without loss of generality 
be assumed to be the set of all integers, Z; recall that we are interested in distributional 
properties only, not in almost sure properties, for instance. 
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Our aim is to extend Theoreni l2.1l and find the asymptotic distribution of the random 
vector (X_s, . . . ,Xt) conditi onally on ||Xo|| > x as ||x || — ?> c«, for all integer s and t 
fCoroUarv lS.ip . According to lBasrak and SegersI (|2009l Theorem 2.1), if the underlying 
process is stationary, the existence of a forward tail process {t e No) is enough to 
guarantee the existence of the tail process as a whole (i S Z). 

Proposition 3.1. Let {Xt : t E Z} be a stationary Markov chain with distribution 
determined by (jl.ip . (|1.2p and p.l[) . If Conditions [KT\ and lKM hold, then there exists 
a process {Mt : t G Z} such that 



C 



X-s 



Xn 



X, 



\\Xo\\ \\X,\ 

for all integer s,t>0. 



\Xo\ 



\Xn\\ >X 



C{M. 



,Mo,...,Mt) (3.2) 



Proof. This follows from our Theorem 12.11 and Theorem 2.1 in 
(|2009f ). combined with a continuous mapping argument. 
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We call the process {Mt : i £ Z} the spectral (tail) p rocess of \Xt : t £ Z|, i n 
ac cordance with the definitio n of the process {9f : t G Z} in lBasrak and SegersI (J2009f ). 



Basrak and Segera (J2009r ) also state an important property of the limiting process. 



Proposition 3.2. Let {Xt : t E Z} be a stationary Markov chain with distribu- 
tion determined by (jl.ip . (|1.2p and (j3.ll) and spectral process {Mt : t G Z}. Then 
for all s,t > and for all bounded and measurable f : (R'')''+*+"'^ — ?► R satisfying 
fiV-s, . . . , 2/t) == whenever y^s = 0, 

A/o 



E[f{M.,,...,Mt)] = E 



f 



\M, 



..^)iiM.ri,.«o, 



(3.3) 



Proof It follows directly from our Proposition l3.1l and Theorem 3.1 in 
(120091 ) that 

Af_, Mt 
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E [f{M. 



s — t, ■ • ■ , 



M(_,;)] = E 



f 



\M,ri 



{M.^a} 



(3.4) 



jM.II' '\\M, 

holds for all bounded and continuous / : (M'')*+''*+^ -^ M satisfying f{y-s, ■ ■ ■ ,yt) — 
whenever yo = (instead of y-s = 0) and all i G Z. We have added the indicator 
function on the right-hand side for greater clarity. Let s, t and / be as in the statement 



Markov tail chains 



of the Proposition. Apply p.4|) to the indices {s,t,i) ~ (0,i + s,s) to arrive at (|3.3|) : 
note that s_+l + t = s + l + t and that f{x-s_, ■ ■ ■ , Xt) = as soon as xq = 0. Thus, 
for functions / which are additionahy assumed to be continuous, the statement follows 
directly. 

For the general case, set for abbreviation A* := (M'*)'*+*+i \ ({0} x (»'')■'+*). Fur- 
thermore, let fi denote the restriction of the law of (M_s, . . . , A/t) to A* and let u 
denote the measure on A* defined by 



Hf) = E 



f 



\M,ri 



|M,||'---'||M, 
for all bounded and continuous / on A*. In order to show 



{A/,5^0} 



for general bounded 

and measurable / with /(y_s, . . . ,yt) = if y_s = it suffices to show that /i and v 
coincide. The closed sets of (M'*)''+*+^ which are bounded away from {0} x (]R'^)''+* 
are a 7r-system generating B(A*). Indicator functions of closed sets A can be written 
as pointwise limits of continuous functions with values in [0, 1]. HA is bounded away 
from {0} X (R'')*+* we can choose these approximating continuous functions in such a 
way that they vanish on {0} x (M'')*+*. Thus, by dominated convergence /i(A) = i'(A) 
for all sets A of a generating 7r-system and therefore fi ^ ly on the Borel sets of A* 



(|Billingslev . 



19681 Theorem 2.2), which finishes the proof. 



By Lemma 2.2 in 



Basrak and Segersl (|2009l ) it follows that the distribution of {Alt 



i 6 Z} is uniquely determined by the distribution of {Mt '■ t ^ Nq} (and a > 0). We 
will use ()3.3p to analyze the structure of the spectral process with a special focus on 
the backward process {M_( : i G No}. At the heart of the connection between the 
forward and backward processes is an adjoint relation between the laws of {Mo, Mi) 
and (Mq, M^i), studied next. 



4. An adjoint relation between distributions 



A special case of the equality p.3p is 



E[/(A/_i,A/o)]=E 



/ 



Mn 



Ml 



\^h\ 



HA/iT^O} 



(4.1) 



for all / : (M'')^ -^ R satisfying f{yo,yi) = whenever yo = 0. Starting from a 
given distribution of (Mq, Mi) we will in the following characterize the distributions of 
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(Af_i, Mo) which satisfy (14.11) . For such an adjoint distribution to exist, the distribu- 
tion {Mo,Mi) cannot be chosen arbitrarily from the distributions on S"^^^ x M.'^. We 
therefore introduce the following set of "admissible" distributions. 

Definition 4.1. For a G (0, cx)), let Aia = J^a,d be the set of all probability measures 
P on S^-i X W^ such that 

l5(m/|lm||) ||m||"P(ds,dm) < P{S x R'^) (4.2) 

S''-ix(R''\{0}) 

for every Borel set S C S**^^. We call Ma the set of admissible distributions for a > 0. 
Note that for P E Ada we have 

||m||"P(ds,dTO) < 1. 

We now make the already mentioned notion of an "adjoint" distribution more concise. 
Definition 4.2. For P e Ma, define a signed Borel measure P* on S'*^^ x W^ by 



/ 



P*{Sx{0}) = P{SxW^)- ls(m/||m||)||m||"P(ds,dm), (4.3) 

JS<'-ix(R<'\{0}) 

P*{E)^ [ lE{m/\\m\\,s/\\m\\)\\mrP{ds,dm), (4.4) 

JS'i-ix(R<'\{0}) 

for Borel sets S CE''^^ and S C S'^"^ x (M'' \ {0}). We call P* the adjomf measure of 
P in Ma- 

Lemma 4.1. Let P E Ma and let P* be as in Definition\4-2\ 



(i) P* is a probability measure and the marginal distributions induced by P and P* 
on S''"^ are the same. 

(ii) For every measurable function f : W^^^ x (R** \ {0}) — > M, 
/(s*, m*) P*(ds*, d?7i*) 



/ 



S<i-ix(R''\{0}) 

= / /(m/||m||,s/||m||)||m||"P(ds,dm) (4.5) 

./s''-ix(R<i\{0}) 

in the sense that if one integral exists, then so does the other, and they are the 
same. 



(Hi) P* e Mc 
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(iv) (P*)* = P. 

Proof, (i) By (|4.2p . P* is a nonncgativc Borel measure. Let S* be a Borel subset of 
S'^-\ We have 

P*{S X M'*) = P*{S X {0}) + P*(S' X (M'^ \ {0})). 

Applying (|4.3p to the first term on the right-hand side and applying (|4.4p with ii^ = 
S" X {W^ \ {0}) to the second term on the right-hand side yields 

P*{S xR'') =P{S xR''). 

It follows that P* is a probability measure (take S = S'^^^) on S"*^^ x M'' inducing the 
same marginal distribution on §'^~^ as P. 

(ii) By (|4.4p . equation (|4.5p holds for indicator functions 1_e of Borel subsets E of 
S''"^ x (M.'^ \ {0}). The extension to general bounded, measurable functions follows 
from the definition of the integral. 

(iii) Let 5 be a Borel subset of E>'^^^. We will apply (|4.5p to the function 

f{s,m) = ls(m/||ml|) l|m||" for {s,m) G S^'-^ x (R'^ \ {0}). 



We find 



ls(m7||TO*||)||TO*||"P*(ds*,dm*) 

S<i-ix(K''\{0}) 

/(s*,m*)P*(ds*,dTO*) 

S'i-ix(R<i\{0}) 

/(TO/||m||,s/||TO||) ||m||"P(ds,dm) 

S''-ix(R''\{0}) 

s/\\m\\ 



I ^o, „, ,„ ||.|, ,,|(.s/|Im||)n|m|rP(ds,dm) 

= P{S X (M^\{0})) 

< P(S' X W^) = P*(S' X W^), 

where we applied (i) in the last step. 

(iv) Let Q = (P*)*. We already know that Q is a probability measure on S'^^^ x M'^, 
that Q E Aia, and that the marginal induced by Q on S''^^ coincides with the one 
of P* and thus with the one of P. Let / be a nonnegative, measurable function on 
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S''^^ X (E^ \ {0}). Define the nonnegative, measurable function g on S''"^ x (R'^ \ {0}) 

by 

g(s,m) = /(m/||?«||,s/||m||)||m||", for {s,m) G S''"^ x (K'' \ {0}). 

We have 

5(m/||m|l,,s/|lm||)||m|r 

f s/\\m\\ m/\\m\\ \ 

By (|4.5p applied first to Q and / and then to P* and g, we have 

/(s, m) (5(ds,d77i) 

.<i-ix(R<i\{0}) 

/(m7||m*||,s7||m*||)||TO*||"P*(ds*,dm*) 



/ (7(s*,m*) P*(ds*,d7Ti*) 

.g(m/|lm||,s/||m|l)|lm||"P(ds,dm) 
f{s,m) P(ds,dm), 



S'i-ix(K'i\{0}) 
S''-ix(K''\{0}) 
S''-ix(K''\{0}) 
S''-ix(K''\{0}) 

where we used (|4.6p in the last step. It follows that Q and P coincide on W^^^ x (R'' \ 
{0}). As Q and P also induce the same marginal distributions on S''^^, it follows that 
they must also coincide on S'^^^ x {0}. As a consequence, Q is equal to P. 

The next lemma shows that the class Ma arid the adjoint relation on it arise 
naturally in the context of regularly varying Markov chains. 

Lemma 4.2. Let {Xt : t ^ Ia] he a stationary Markov chain with distribution de- 
termined by pTTj) . (fr2|) and ((3?T|) . // Conditions [2l\ and [EE hold, then jC{Mo,Mi) 
belongs to AIq cind its adjoint is equal to C{Mo, M^i). 

Proof. To prove admissibility, we have to show that 

E[l5(A/i/||A/i||) llA/iir] < P(A/o e S) (4.7) 

for every Borel set S C S"*^^. Let / be a bounded, nonnegative and continuous function 
on S'^~^. We will show that 

E[/(A/i/||Afi||)l|A/i|n<E[/(Afo)]. (4.8) 
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Equation (|4.8p implies (|4.7p for cfoscd sets 5 because the indicator function of a cfosed 
set S can be written as the pointwise hniit of a decreasing sequence of continuous 
functions taking values in the interval [0, 1]. From this we arrive at (|4.7p for an arbitrary 
Borel set S by invoking an increasing sequence of closed sets 5„ contained in S such 
that E[l5„(A/i/||A/i||) llMill"] and P(A/o e S,,) converge to E[l,9( Mi /||Mi ||) ||Mi ""^ 



and P(Mo G S) respectively; see for instance Theorem 1.1 on p. 7 in lBillingslevI (jl968l ). 
Let S > 0. By stationarity of {Xt : t £ Z} and by definition of the spectral process 
{Alt '■ t G Z}, we have 

E[/(Afo)] - lim E[/(Xi/||Xi||) I llXill > x] 

> limsupE[l{||Xo||>fe} /(Xi/llXill) I llXill > x] 

a;— J-oo 

= limsup^l||M^E[/(Xi/||Xi|I)l{||;,^ll>,} I llXoll ><5x] 

= ,5-"E[/(A/i/||Mi||)l{y||Mi||>i-i}]. 

In the last line, F is a Pareto(Q;) random variable, independent of Mi. As P(y ||Afi|| ~ 
S^^) = by continuity of the law of Y, the last equality in the above display follows 
from the continuous mapping theorem. 

Since the distribution of Y^" is uniform on the interval (0, 1), we have 

r"E[/(Mi/||A/i||) l{^||M,||>5-i}] = r"E[/(A/i/||A/i||) 1{,»||M,||^>F-^}] 

= 5-"E[E[/(A/i/||Mi||) l{,.||M,||»>y-»}|Mi]] 

= 5-"E[/(A/i/||Afi||) min(<5"p/i|r,l)] 

= E[/(A/i/||Afil|)min(l|A/il|",r")]. 

We obtain that for every S > 0, 

E[/(A/o)] > E[/(A/i/||A/i||) min(||A/i|r,(5-")]. 

Take the limit as (5 — > and apply the monotone convergence theorem to obtain (|4.8p . 
Next we show that the adjoint of C{Mo,Mi) is equal to £(A/o, A/_i). We have to 
check the two equations 

P((A/o,A/_i) G 5 X {0}) =P(A/o G 5) -E[lR.\{o}(Mi)l5(A/i/I|A/i||)||A/iir], 

P((A/o, A/_i) eE)= E[1r.\{o}(AA)1b(A/i/||A/i|[, A/o/l|A/i||)||Afiin, (4.9) 
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for all Borcl sets S C S'^"^ and E C S'^^^ x (M'^ \ {0}). Since the first component Mq 
is common to both laws, it is sufficient to check only the second equation, (|4.9p . 

Set /(m_i,mo) = l£;(7Tio, m_i) on M x S'^^^ Note that /(0,7tio) = 0. Apply 
equation (|4.ip to /: 

P((Mo,M_i) e £;) = E[/(M_i, A/o)] 

= E[/(Mo/||Mi||,Mi/||A/i||)||A/iri{Mi^o}] 

= E[l^.\^o^{M,)lE{Ml/\\Ml\\,Mo/\\^h\\)\\^hr], 

which gives (|4.9p . as required. 

Remark 4.1. The determination of the adjoint measure is particularly simple for 
probability measures P such that 

f ||m||"P(ds,dm) = 1, (4.10) 

since in this case P*{§'^~^ x {0}) = by (|4.3p and P* is completely described by (|4.4p . 



Definition 14.21 and Lemma [4.11 generalize Proposition 3.1 in ISegersI ([2007|) to the 
multivariate case. Examples 3.2-3.4 in the latter reference illustrate the adjoint relation 
for laws on { — 1, +1} x R. We conclude the section with a multivariate example. 

Example 4.1. Let a > and let P be the law of (/, RQI) with /, R and Q indepen- 
dent, / taking values in §^^^, R a positive random variable with E[i?"] — 1, and Q a 
random orthogonal d x d matrix, that is Q' ~ Q^^ a.s.; also assume that the laws of 
/ and QI are the same (cf. also Example 16. ip . One verifies easily that P ^ Ada and 
that (|O0l) holds, so that the adjoint law P* is concentrated on S"^"! x (M'^ \ {0}). It 
may thus be derived from (|0|) that for Borel sets S C S''"^ and T C K'^ \ {0}, 

P*{S X T) = E[1s{QI)1t{I/R)R% (4.11) 

It follows that P* is the law of (/*, R*Q*I*), with /*, R* and Q* independent, C{I*) = 
£(/), C{Q*) = C{Q'), and the law of i?* > given by E[f{R*)] = E[f{l/R)R"] for 
measurable functions / on (0, oo). 
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5. Back-and- forth tail chains and the spectral process 

In this section, we will analyze a certain class of discrete-time processes which are 
constructed from a pair of adjoint distributions. We will see that this class of processes 
fulfills equation p.3|) for all i,s,t e Z with s < < t. 

Definition 5.1. A d-dimensional discrete-time process {Mf : t G Z} is called a back- 
and-forth tail chain with index a > 0, notation BFTC(a), if the following properties 
hold: 

(i) C{Mq,Mi) and C{Mo,M-i) belong to Ma and are adjoint; 

(ii) the forward process {Mt : t G No} is a Markov chain with respect to the filtration 
(t{Ms, — oo < s < t), t > Q, and the Markov kernel satisfies 

P{Mt G • I Mt-i = xt-i) 

6o{-) if xt-i = 0, 

P{\\xt-i\\Mi G • I Afo = xt-i/\\xt-i\\) if xt-i + 0; 

(iii) the backward process {il/t : t G Nq} is a Markov chain with respect to the 
filtration cr(A'/_s, — oo < s < i), i > 0, and the Markov kernel satisfies 

P(Af_t G • I M_t+i = x_t+i) 

(5o(-) if a;_t+i =: 0, 

P(||x_t+i||A/_iG • \M^ = x-t+il\\x-t+A) ifx_t+i^O. 

Clearly, {Mt : i G Z} is a BFTC(a) if and only if {M_t : i G Z} is a BFTC(a). The 
distribution of a BFTC(a) is completely determined by an admissible law of (Afo, M\) 
(and a > 0). 

The fact that the distributions P = £(Afo, Mi) and P* = £(Afo, M-{) are adjoint in 
M.a implies that for every measurable function / : M^ x S'^^^ — > K such that /(O, s) = 
for all s G S"^^^, we have 



E[/(A/_i,A/o)]= / /(m,s)P*(ds,dm) 



/(s/||m||,m/||m||)||mrP(ds,dm) 
S''-ix(M''x{0}) 
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E 



/ 



Mn 



Ml 



I Ml I 



4Mi#0} 



(5.1) 



iMiiniMil 

in the sense that if one expectation exists, then so does the other, the two expecta- 
tions being equaL This corresponds to equation (j4.ip which originally motivated the 
definition of an adjoint distribution. The above formula is the special case s = 1 and 
i = of the following result. 

Proposition 5.1. Let {Mt : t e Z} be a BFTC(a). For all integer s,t > and for all 
measurable functions f : (M'^)*+-'^+* — > M vanishing on {0} x (R'')""''*, the s + 1 numbers 



E 



M_ 



s~\-i 



Mt+, 



iiM,ri{M.^o} 



0, 



(5.2) 



\m\\ '■■■'ii^dL 

are all the same, in the sense that if one integral exists, then they all exist and they 
are equal. 

Proof. For s = there is nothing to prove, so assume that s > 1. By definition of 
the integral, it is sufficient to consider the case where / is nonnegative, in which case 
the expectations in (|5.2p are always well-defined, possibly equal to infinity. 

Reduction to the case i G {0, 1}. Suppose first that we can show that the numbers 
corresponding to z — and i = 1 in (|5.2p are equal, that is (note that ||Aio|| = 1), 



E[/(A/_,„...,A/0]-E 



/ 



M_ 



s+l 



M, 



t+i 



Take arbitrary 1 = 0,.. 



E 



Mil 
s — 1. Note that 



I Ml I 



iMiri{M,^o} 



(5.3) 



4A/,#0} 



= ELg(A/_,+, 



,M, 



t+i) 



\M4 ' ' \\M4 

for a measurable function g : (]R'^)'*+^+* — 5- R with that vanishes as soon as its first 
d-tuple of arguments is zero. By ()5.3p applied to s = s — i and t = t + i, we find 



M_ 



s+i+l 



m\\ 



E[g{M^,+,,...,Mt+,)]^E 

By definition of 5, if Mi ^ 0, then 

I M_s+i+i_ Mf+i+ i 

\ \\Mi\\ '---jMi 

^^fM_^s+^+l/\\Ml\\ Mt+,+i/\\Mi 



M, 



t+i+l 

\Mi\\ 



iAfiiri{M,#o} 



= / 



^||(M,+i/|lA/i||)||"-"||(A/,+i/||A/i||) 

M_,+,+ i Mt+,;+i\ ||A/,+ i"" 



IM 



i+i\ 



IM 



i-|-l| 



iMill" 



|(M,+i/||Mi| 

l{M.+i7to}- 



L{A/.+i#0} 
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Combine the previous three displays to see that 



E 



^/-. 



Mi 



t+i 



UM\ '""\\M4 



i^.iri{M.^o} 



= E 



M-s^ 



i+i 



Mi 



t+i+l 



\M, 



i+l\\ ^{Mi^O,Mi+i¥^0} 



||M,+i|| '■•■'llM.+ill, 
By definition of the forward chain (Afj)t>o, we have Af^+i = as soon as Mi = 0. As 
a consequence, we may the suppress the event {Mi ^ 0} in the indicator function on 
the right-hand side, and thus 



E 



A/_ 



S + ? 



Mi 



t+i 



\M, 



"UhW 



\M, 



= E 



LiM.^O} 



Af_ 



s+i+l 



Mi 



t+i+l 



|M,+i|| \\M,+i 

We conclude that in order to show (|5.2p , it is enough to show 
by induction on s > 1. 

Proof of (|5.3|) if s = 1. We have to show that 

Mo Mt+i ■ 



M+iiri{A/i+i#o} 

We will show 



E[/(M_ 



,MO]=E 



Mil 



4^/15^0} 



(5.4) 



,||Mi||'---'||Mil 
We will proceed by induction on t > 0. 

The case i = is nothing more than the adjoint relation between the laws of 
(Mo, Ml) and (Mo,M_i), see ([5J|) . 

Let i > 1 and let (|5.4p be fulfilled for f — 1. By the Markov property. 



with 



E[/(A/_i, . . . , Mt)] - E[5(M_i, . . . , Mt-i)] 



5(TO_i,...,TOt_i) = E{/(m_i,...,mt_i,Mt) | Mt_i = rut-i} 
As 5(0, Too, . . . , rrit-i) = 0, we can apply the induction hypothesis, yielding 

E[5(Af_i, . . .,Mt-i)] = ELg(A/o/||Mi||, . . .,Mt/Uh\\) l|Mi|r 1{m,^o}]- 

The defining property of a bftc implies that for every c > 0, for every integer r > 1 
and for every nonnegative, measurable function h on M."^, 



E[h{cMr) I Mr-i = m/c] 



HO) 



if m = 0. 



E[h{\\m\\Mi) I Mo = m/||m||] if m 7^ 0, 



(5.5) 
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the right-hand side not depending on the scaling constant c nor on the time index r. 
It foUows that a mi ^0, 

9{mo/\\mi\\, . . . ,m.t/\\mi\\) 

= E[/(mo/||"ii||,...,mt/||mi||,Mt) \ Mt-i ^ mt/\\mi\\] 
= E[/(77io/||TOi||,...,mt/|[mi||,Aft+i/||mi||) | M* = m*]. 

We find that, on the event {Mi ^ 0}, by the Markov property, 

giMo/\\Mil...,Mt/\\Mi\\) 

= E[f{Mo/\\Mi\\,. . . , M,/||Afi||, Af,+i/||Mi||) | Mo, ■ • ■,Mt]. 

We can conclude that 

E[/(Af_i,...,A/0] 
= EL9(A/_i,...,Aft_i)] 

= ELg(i\/o/p/i||, . . .,Mt/\\Mi\\) llMiir 1{m,#o}] 
= E[/(AVP^i||,---,M,/||Afi||,A/*+i/p/i|I)p/irip,,^o}], 

as required. 

Proof of (|5.3p for general s > 1. The case s = 1 was treated above. So let s > 2. 
By the Markov property, we have 

E[/(Af_„ . . . , Mt)] = E[g(i\/_3+i, . . . , Mt)] 

with g : (R'')*+* — !> R a nonnegative, measurable function defined by 

g{m_s+i,...,mt) = E{f{M_s,m_s+i, . . . ,m,t) \ M^^+i =m-s+i}- 

Conditionally on M^s+i = 0, we have M-s = 0, and thus /(A/_s,...) = too. It 
follows that g(0, m^s+2, ■ • • , 'nit) = 0. By the induction hypothesis, we therefore have 

E[(7(A/_3+i, . . . , Mt)\ = ELg(A/_,+2/p/i||, . . . , A/t+i/p/i||) p/iP 1{Mi^o}]- 

As for the forward chain in (|5.5|) . we have for every nonnegative, measurable function 
h on W^ and every c > 0, 

{/i(0) ifm^O, 

(5.6) 
E[;i(||mp/_i) I A/o = ml\\m\\ if to 7^ 0, 
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the right-hand side not depending on the scahng constant c > nor on the time index 
r = 1, 2, . . .. It foUows that for mi ^ 0, we have 

g{m^s+2/\\mi\\, ■ ■ . ,mt+i/||mi||) 

= E[/(Af_3,m_5+2/||mi||,...,7Tit+i/||TOi||) | M^s+i = m_s+2/||"^l||] 
= E[/(i\/_s+i/|[mi||,m_s+2/||"ii||, . . . ,mt+i/||mi||) | M-s+2 = m_s+2]- 

Invoking the Markov property again, we eonclude that 

E[/(Af_„ . . . , Mt)] = E[9(A/_,+i, . . . , Mt)] 

= E[5(M_,+2/||Mi||, . . . , A.f,+i/||Mi||) IIMiir 1{m,^o}] 
= E[/(M_,+i/||A/i||, . . .,Mt+i/\\Mi\\) llMiir l{Mi^o}], 

as required. This coneludes the proof of Proposition 15. II 

The foUowing proposition connects BFTCs and spectral processes. 

Proposition 5.2. Let {Yt : t 6 Z} be an W^-valued process and let {Mt : t G Z} be an 
W^ -valued BFTC (a). If 



C{Yo,...,Yt)^CiMo,...,Mt) 
for all t > and if 

E[/(y_„...,y,)] = E / 



Yn 



K 



s+t 



for all s,t > and for all bounded and measurable f 
f{y-s, .. ■,yt) =0 whenever y^s = 0, then 



(nd\s+t+l _ 



£(y_,,...,rO = 'C(A/_, 



,Mt) 



(5.7) 

(5.8) 
satisfying 

(5.9) 



for all s,t > 0. 

Proof. The proof rehes on the fact that both the process {Yt : t e Z} which satisfies 
(|5.8p and the BFTC(a) are uniquely determined by their forward process. Our proof 
is by induction on s. For s = 0, equation (j5.9|) is equal to the assumption (|5.7p for all 
t > 0. For the induction step, assume that (|5.9p holds for a fixed value of s = s — 1>0 
and alH > 0. Let / : (R'')''+*+^ — > K be a bounded continuous function. Write 



f{y-s,---,yt) = fiiy^s,---,yt) + f2{y-s 



,yt) 
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with 

.fi{y-s,---,yt) = f{0,y-s+i,---,yt), 
f2{y-s,---,yt) = f{y-s,y-s+i,---,yt) - f{0,y-s+i,---,yt)- 

and note that /2(0, y-s+i, ■ ■ ■ ,yt) =0, while the value of /i does not depend on the 
first coordinate of the argument. Then 

E[/(y_„...,y,)] 
= E[/i(y_„ ...,Yt)] + E[/2(y-., . . .,Yt)] 



E[/i(A/_„...,A/0]+E 






where both the induction hypothesis and equations (|5.8p and (|5.9p have been used. 
Since {Mt : t e Z} is a BFTC(q;), wc may apply Proposition 15.11 for i = s and i = 
(note that ||A/o|| = 1), so that the above expression is equal to 

E[/i(M_3, . . . , Mt)] + E [/2 (M-„ . . . , Mt)] = E[/(M_„ . . . , Mt)], 

which finishes the induction step and the proof. 

Remark 5.1. Proposition l5.2l can be read in the following wav: Every spectral process 
{Alt : t <E Z} with a forward process (meaning: {Alt '■ t G ^o}) which has a BFTC(a) 
structure, automatically has a BFTC(a)-backward-distribution as well. This means 
that a Markovian structure in the forward spectral process (which may also arise 
in settings where the underlying process is non-Markovian) is enough to secure a 
Markovian structure of the backward spectral process as well. 

Corollary 5.1. Let {Xt : t G Z} be a stationary Markov chain with distribution 
determined by (|l.ip . (jl.2p and (j3.ip . Then the corresponding spectral process {Mt : 
teZ} is a BFTC{a). 

Proof. The existence of a corresponding spectral process follows from Proposition 
13.11 Furthermore, it follows from Theorem 12. II that the forward process {Mt : i G Nq} 
is equal in law to the forward process of a BFTC(a). By Proposition l5.2l the statement 
follows. 
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In the univariate case, BFTCs have an additional structure which gcncrahzes a 
niuhiphcative random walk in that the distribution of the increment depends on the 
sign of the process in its current state (ISegers . 



the forward tail chain was first observed in 



2007). The random walk structure of 



SmithI (I1992I ) fo r one-sided extremes an d 



extended to allow for both positive and negative extremes in iBortot and Colea (J2003I ) 



6. Examples for BFTCs 



We conclude the paper with some examples of BFTCs for multivariate Markov 



processes. For univariate examples, see 



Segerj (120071 section 7) 



Example 6.1. Let {At,Bt),t e Z, be i.i.d. with At £ R'^'"^ and Bt £ R'^. The 
stationary distribution and asymptotic behavior of the corresponding random difference 
equation 

Xt^AtXt-i+Bt, teZ, (6.1) 



have been studied initially in the seminal work by iKestenI (|l973l ). Let us assume 
that the distribution of {At,Bt) satisfies the technical, but mild assumptions of The- 
orems A and B (nonnegative case, i.e. all com ponents of Xt. t G No, arc nonncgative 



al most surely) or Theor e m 6 ( general case) in iKestenI (|1973l ) . Together with results 



Boman and Lindskoa (|2009l ) this implies that the stationary distribution of Xt for 



(|6.ip is multivariate regularly varying in the no nnegative cas e. In the general case, 
multivariate r egular variation follo ws if ki > in 



Kesten 



an integer, cf. 



Basrak et al. 



|l973l ). Equation (4.8), is not 



()2002l) . Let T denote the spectral measure and a > the 
index of regular variation of the stationary distribution of Xf. In this case, it can be 
shown that 



E 



'Kra)"^^"" 



= E[/(/)] 



3.2) 



for all bounded, continuous funtions / on S'^ ^ , where / g S'^ ^ has distribution T and 
A G R'*'''' is independent of / with C{A) = C{Ai), cf. basrak and SegersI \2009i] . 

Due to the linear structure of (|6.ip . Theorem 12 . 1 1 applies with P{Y > y) = y^", y > 
l,C{Mo) = T and (f>{Mj_i,ej) = ejM,_i where the e^ G M.'^'^'^J = 1, 2, . . . , are i.i.d. 
with C{ej) = £(^1). In order to find the distribution of the backward tail chain note 
that Remark |4 . 1 1 applies to this example by equation (|6.2p . So the law P* of (A/q, M_i) 
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is given by 



P*{E) =E 



AI 



\Air 



(6.3) 



\Air\\Aii 

for all Borcl sets E cS'^^^ xW^. 

Additional assumptions about C{A) allow us to simplify this characterization: Let 
us assume that A has a multiplicative form like in Example 14. 1[ i.e. A ~ RQ for a 
positive random variable R with E[i?"] = 1 and Q is an orthogonal matrix independent 
of R. We may additionally assume that both R and Q have a density on R+ and 
gd-i respectiv ely and that E [||_Bi||"] < oo which guarantees that all assumptions of 



Theorem 6 in 



KestenI (|l973l ) are met. The spectral measure T is then the uniform 



distribution on S and a > is the index of regular variation since 



E 



'{my"' 



= E [/ (Q/) i?"] = E [/ (Q/)] E[i?"] = E[/(/)] 



holds for all bounded, continuous functions / on S"^"^ if / ^ Unif(§'^~^). Since 
£(/) = C{QI), all assumptions of Example 14. II are met and the adjoint measure P* is 
determined by (|4.11|) and equal to the law of {I* ,R*Q*I*) with R* , Q* ,1* independent, 
£(/*) = Unif(§'^-i), C{Q*) = C{Q') and R* has density fR,{y) = fR{y-^)y~^^+''\ 
y > 0, where f^ denotes the density of R. Thus, both the forward and the backward 
tail chain have a simple multiplicative structure: 



Mt = MoAi ■ ...-At, 



M_ 



MnA. 



1 • 



..■A. 



t > 1, 



with Ai,A2,... as above and A_i, A^2, ■ ■ ■ i.i-d. with the same distribution as R*Q* 
all independent of each other and of A/q ^ Unif(§''~^). 



Example 6.2. While the preceding example dealt with ran dom difference 



equations 



where the random increment Bt has a relatively light tail [KestenI (|l973l ) assumes 
that i?(||i3i||") < oo], the following example deals with AR(1) processes where the 
innovations themselve are regularly varying. Let 



Xt = AXt 



Bt 



t e Z, (6.4) 

where A is a deterministic R'^^'^-matrix and Bt G M'', t E Z, are i.i.d. and multivariate 
regularly varying with index a > and spectral measure A o n S^ ~^. For extensions to 
rando m but light-tailed random matrices At , see for instance 

poosi) . 



Hult and Samorodnitskv 
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If sup^ggd-i l|A™x|| < 1 for some positive integer m, then (|6.4p has the stationary 
solution 

oo 



It has been shown in 



n-O 



Meinguet and Segera (120101 ) that in this case the stationary 



distribution of Xt is multivariate regularly varying as well, with the same index a and 
spectral measure T = J2'^=oPn'^n, where 



Pn 



^oo with c„ := / We\\ A(d0), n e No, 



and where A„ is the spectral measure of A^B, provided c„ > 0, i.e. 

P"s||"A(ds), neNo, if c„ > 0, 



^-^^^ '- i L-J [JA^I 



for all bounded, continuous functions / on 



5d^l 



(JMeinguet and Segers . 



20101 Exam- 



ple 9.3). The spectral process {Mt : t G Z} in Proposition 13. II is of the form 

A*e, i = 0,1,2,..., 



M_ 



N+t 



(6.5) 



0, 



i = -l,-2,... 



for a random integer N with P(A^ = n) = p„, n G Nq, and a random vector O with 
distribution 

P{eeE\N = n) = — f 1e{s/\\A"s\\) ||A"s||" A(ds) 

for 71 G No and Borel sets E G M"*. Here, the forward tail chain has a deterministic 
multiplicative structure with Mo ^ T and M„ = AMn-i for n > I. The backward 
process is Markovian as well, by Corollarv l5.ll This is also clear if one looks at (|6.5I) and 



notices that M_ 



(n+h) 



=: if A/_„ = for all /i > l,ri > 1. Furthermore, if A/_„ ^ 



then (M_„+i, . . . , Afo) = (^A/_„, . . . ,74"A/_„) contains no more information about 
M_/n+i) than Af_„ does. 

The distribution of (A/o,A'/_i) is adjoint to the one of {Mo,Mi) = {Mo,AMo). By 



14. 4p and since Mq ~ T, wc find, for every Borel set E CS' 



d-l 



P((Afo,Af-i)GS)=E 



A/i Mo 



mr\m\ 



Eoo 



E 

n>0 



S'i-i 



|A/i||° 



u"+isir iu"+isi 



\{0}), 



||A"+\s||"A(ds). 
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Choosing E = S x (E.'^\{0}) for a Borcl set S C S'^~^ yields, upon taking eomplements 
with respeet to {Mq £ S} and noting that j|s|[ = 1 for s G E"^^^, 

P(A/o e S, A/_i = 0) = ^ A(5). (6.6) 

In partieular, P(A/_i = 0) = pc = P{N = 0). The backward tail chain now follows 
from Definition IS-lT iii) together with the distribution of (Mq, M-i). 

In the special case that A is invertible, we find from (|6.5p that M^(^t+i) is equal 
to either A^^M^t or to with conditional probabilities depending on Af_t/[|A/_t[|: if 
M-t = 0, then M_(f^i-f = too, while if M-t = x y^ 0, then 



M-(t+i) 



A~^x with probability 1 - P(A/_i = | 7\/o = a;/||a;||), 
with probability P(Af_i = | A/q == a;/||x||). 

To derive a concrete form of the backward Markov kernel, let us assume that A has a 
Lebesgue density ]\ on S''^^. Then all measures A„ and thus T have Lebesgue densities 
as well and (|6.6p gives us 

P(A/_i ^ I A/o = s) = ^i {^['1 

for ah s^W^-^ such that /t(s) > 0. 
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